REMARKS 

Claims 1-19 are pending and rejected in the present application. Claims 5 and 13 are 
canceled hereby, claims 1, 7-9, 12 and 19 are amended hereby; and claims 20-22 are added 
hereby. 

The specification has been amended to correct a minor typographical error and to include 
an incorporation by reference of the provisional patent application to which the present 
application claims priority. 

Responsive to the rejection of claims 1, 8, 9 and 19 under 35 U.S.C. 1 12, first paragraph. 
Applicants have amended claims 1, 8, 9 and 19 and submit that claims 1, 8, 9 and 19 are now in 
allowable form. The Examiner states that the "examiner interprets a first and second stage input 
as two inputs, each input received fi-om a different peripheral device." However, Applicants 
submit that the limitation that each input is received fi-om a different peripheral device is not 
included in the claims, and the claims are not to be interpreted as having that limitation. That is, 
unless otherwise indicated, the claims are to be interpreted broadly enough to encompass each 
input being received either from a same device or from different devices. 

Claims 1, 2, 5-8, 10-15, 17 and 18 were rejected under 35 U.S.C. §103(a) as being 
unpatentable over U.S. Patent No. 6,377,925 (Green, Jr. et al.) in view of Lemlouma. 
Responsive thereto, Applicants have canceled claims 5 and 13, amended claims 1, 7-8 and 12 
and respectfully submit that claims 1, 2, 6-8, 10-12, 14-15, 17 and 18 are now in condition for 
allowance. 

Claim 1, as amended, recites in part "entering a first input and a second input; translating 

the first input and the second input into an electronic format; converting the electronic format 
into standard XML encoded with accessibility information ". (Emphasis added). Applicants 
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respectfully submit that such limitations are neither taught, disclosed nor suggested by the cited 
references, alone or in combination, and include distinct advantages thereover. 

As the Examiner acknowledges, Greene does not disclose converting an electronic format 
into standard XML encoded with accessibility information. Thus, Greene does not disclose or 
suggest entering a first input and a second input, translating the first input and the second input 
into an electronic format, and converting the electronic format into standard XML encoded with 
accessibility information, as recited by amended claim 1. 

The Examiner cites Lemlouma as disclosing that "documents are saved in a server using 
XML format, and a user profile, which dictates user preferences for data presentation, are stored 
as an XML file.'" However, a user profile which dictates user preferences for data presentation is 
not accessibility information. Accessibility information is non-textual, semantic information that 
indicates non-verbal aspects of the textual communication, such as tone of voice and emotional 
content, for example. As is evident from the example client profile in Figure 2 of Lemlouma, the 
user profile is unrelated to semantic or non-verbal aspects of any particular text message. 
Rather, the client profile of Lemlouma may apply to any content, and is unrelated to and 
independent from the content. 

Moreover, the client profile of Lemlouma is not obtained by the steps of entering an 
input, translating the input into an electronic format, and converting the electronic format into the 
client profile. Rather, as shown in Figure 1 and discussed in section 4.2 of Lemlouma, the client 
profile is stored in the User Context Module (UCM) on the client side of the architecture (the 
right-hand side of Figure 1). The UCM specifies device capabilities, and is independent of any 
document contents or other inputs. The UCM is also separate and independent from the XML 
document base on the server side (the left-hand side of Figure 1). Thus, the client profile is not 
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obtained by entering an input, translating the input into an electronic format, and converting the 
electronic format. 

For all of the above reasons, Lemlouma does not disclose or suggest entering a first input 
and a second input, translating the first input and the second input into an electronic format, and 
converting the electronic format into standard XML encoded with accessibility information, as 
recited by amended claim 1 . 

The present invention includes distinct advantages over the cited references. By 
translating two inputs into an electronic format and converting the electronic format into 
standard XML encoded with accessibility information, it is possible for users with disabilities to 
communicate non-verbal aspects of textual messages. For example, one of the inputs may 
include textual information, and the other input may include information pertaining to tone of 
voice, emotional content, points of emphasis, etc. 

For all of the above reason, claim 1, and claims 2, 6-8, 10-12, 14-15, 17 and 18 
depending therefrom, are in condition for allowance, which is hereby respectfully requested. 

In addition to being allowable by virtue of depending from claim 1, claim 6 is separately 
patentable. Claim 6 recites in part that the "entering step includes semantic information." 
(Emphasis added). Applicant respectfiiUy submits that such limitations are neither taught, 
disclosed nor suggested by the cited references, alone or in combination, and include distinct 
advantages thereover. 

The Examiner cites column 4, lines 65-67 of Greene as disclosing speech inputs. 
However, speech inputs generally do not include semantic information. Semantic information is 
non-verbal information that may add emotional content or emphasis to verbal content, for 
example. The American Heritage Dictionary defines "semantic" as "[o]f or relating to meaning. 
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especially meaning in language." Thus, semantic information may enhance the meaning of 
verbal content. For example, a blind user could speak the word "smiley-face" to embed a 
smiley-face emoticon (page 23, lines 10-11 of the present specification). Thus, the cited 
references do not disclose or suggest an entering step including semantic information, as recited 
by claim 6. For the above reasons, claim 6 is in condition for allowance, which is hereby 
respectfully requested. 

In addition to being allowable by virtue of depending fi-om claim 1, claim 7, as amended, 
is separately patentable. Claim 7 recites in part that the "entering step includes providing 
formatting and structure for text ." (Emphasis added). Such subject matter is disclosed at page 5, 
lines 27-28 of the present specification. Applicants respectfully submit that such limitations are 
neither taught, disclosed nor suggested by the cited references, alone or in combination, and 
include distinct advantages thereover. 

Enabling or disabling of the translation functions of Greene does not provide formatting 
and structure for text. Rather, the translation functions translate content between text, speech, 
sound, etc. Thus, the cited references do not disclose or suggest that an entering step includes 
providing formatting and structure for text, as recited by amended claim 7. For the above 
reasons, claim 7 is in condition for allowance, which is hereby respectfully requested. 

In addition to being allowable by virtue of depending from claim 1, claim 8, as amended, 
is separately patentable. Claim 8 recites in part "the first input including verbal information, and 
the second input including non-verbal information." (Emphasis added). Such subject matter is 
disclosed at page 23, lines 18-20 of the present specification. Applicant respectfully submits that 
such limitations are neither taught, disclosed nor suggested by the cited references, alone or in 
combination, and include distinct advantages thereover. 
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The cited references are completely silent as to a first spoken input including verbal 
information and a second spoken input including non-verbal information. Thus, the cited 
references do not disclose or suggest that a translating step includes the use of automatic speech 
recognition of a first input and a second input to produce an electronic format, the first input 
including verbal information, and the second input including non-verbal information, as recited 
by amended claim 8. For the above reasons, claim 8 is in condition for allowance, which is 
hereby respectfiiUy requested. 

In addition to being allowable by virtue of depending fi-om claim 1, claim 9, as amended, 
is separately patentable. Claim 9 recites in part that the "translating step includes the use of sign 
language recognition of the first input and the second input to produce the electronic format, the 
first input including verbal information, and the second input including non-verbal information." 
(Emphasis added). As discussed above with regard to claim 8, the cited references are 
completely silent as to a first input including verbal information and a second input including 
non-verbal information. The cited references are also completely silent as to entering such 
verbal and non-verbal inputs by use of sign language. Thus, the cited references do not teach, 
disclose or suggest that a translating step includes the use of sign language recognition of a first 
input and a second input to produce an electronic format, the first input including verbal 
information, and the second input including non-verbal information, as recited by amended claim 
9. For the above reasons, claim 9 is in condition for allowance, which is hereby respectfully 
requested. 

Claims 4 and 16 were rejected under 35 U.S. C. 103(a) as being unpatentable over Greene 
in view of Lemlouma and fiirther in view of Blattner. However, claims 4 and 16 depend fi-om 
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claim 1, which is in condition for allowance for the reasons given above. Accordingly, claims 4 
and 16 are also in condition for allowance, which is hereby respectfully requested. 

Claims 3 and 9 were rejected under 35 U.S.C. 103(a) as being unpatentable over Greene 
in view of Lemlouma and further in view of Sakiyama. However, claims 3 and 9 depend from 
claim 1, which is in condition for allowance for the reasons given above. Accordingly, claims 3 
and 9 are also in condition for allowance, which is hereby respectfiiUy requested. 

Claim 19 was rejected under 35 U.S.C. §103 (a) as being unpatentable over U.S. Patent 
No. 5,953,693 (Sakiyama) in view of Lemlouma and fiirther in view of U.S. Patent No. 
6,865,599 (Zang). Responsive thereto, Applicants have amended claim 19 and respectfully 
submit that claim 19 is now in condition for allowance. 

Claim 19, as amended, recites in part "entering a first input including verbal information 
and a second input including non-verbal information". (Emphasis added). Applicants 
respectfully submit that such limitations are neither taught, disclosed nor suggested by the cited 
references, alone or in combination, and include distinct advantages thereover. 

The cited references are completely silent as to a first input including verbal information 
and a second input including non-verbal information. Thus, the cited references do not disclose 
or suggest entering a first input including verbal information and a second input including non- 
verbal information, as recited by amended claim 19. 

Moreover, claim 19, as amended, recites in part "the second input being entered in 
parallel with the first input, the second input being entered via a same medium as the first input, 
the same medium being one of a visual medium and an audial medium ". A deaf user, for 
example, could enter the verbal and non-verbal inputs in parallel via a same visual medium such 
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as sign language recognition. As another example, a blind user could enter the verbal and non- 
verbal inputs in parallel via a same audial medium such as automatic speech recognition. 

The cited references are completely silent as to verbal and non-verbal inputs being 
entered via a same visual or audial medium. Thus, the cited references do not disclose or suggest 
a second input being entered in parallel with a first input, the second input being entered via a 
same medium as the first input, the same medium being a visual medium or an audial medium, 
as recited by amended claim 19. 

The present invention as recited by claim 19 includes distinct advantages over the cited 
references. A user with a disability may be able to provide inputs via only a single type of 
medium. For example, a blind user may be able to enter inputs though only an audial medium 
such as speech recognition. Thus, the present invention enables disabled users to enter both 
verbal and non-verbal information in parallel (i.e., as the user conceptualizes the verbal and non- 
verbal information in conjunction with each other) via a same single medium that may be the 
only medium that the disabled user may effectively use. 

For the above reasons, claim 19 is in condition for allowance, which is hereby 
respectfiiUy requested. 

Claim 20 has been added to fiirther protect the patentable subject matter of the present 
invention. Claim 20 recites "entering a first input including text information and a second input 
including semantic information ; translating the first input and the second input into an electronic 
format; converting the electronic format into standard XML encoded with accessibility 
information ." (Emphasis added). The cited references are completely silent as to entering a first 
input including text information and a second input including semantic information. As 
discussed above with regard to claim 6, the semantic information may enhance the meaning of 
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the text information with emotional content or points of emphasis, for example. Moreover, as 
discussed above with regard to claim 1, none of the cited references discloses converting an 
electronic format into standard XML encoded with accessibility information. 

Claim 21 has also been added to further protect the patentable subject matter of the 
present invention. Claim 21, depending from claim 19, recites that "the same medium comprises 
automatic speech recognition ." (Emphasis added). Thus, both verbal and non-verbal 
information are entered in parallel via speech recognition. Applicants submit that claim 21 is in 
condition for allowance, which is hereby respectfully requested. 

Claim 22 has also been added to further protect the patentable subject matter of the 
present invention. Claim 22, depending from claim 19, recites that "the same medium comprises 
sign language recognition ." (Emphasis added). Thus, both verbal and non-verbal information 
are entered in parallel via sign language recognition. Applicants submit that claim 22 is in 
condition for allowance, which is hereby respectfully requested. 
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CONCLUSION 

Applicants believe, in view of the amendments and remarks herein, that all grounds of 

rejection of the claims have been addressed and overcome, and that all still pending claims are in 

condition for allowance. 

In the event any issue(s) remain that could be resolved by telephone, the undersigned 

invites the Examiner to contact him to expedite the examination of this application. Thank you. 

Respectfully submitted, 

/Keith J. Swedo/ August 21, 2007 

Keith J. Swedo, Reg. No. 43,176 
Sommer Barnard PC 
One Indiana Square 
Suite 3500 

Indianapolis, Indiana 46204-2023 
Phone: (317)713-3500 
Fax: (317)713-3699 
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